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Abstract 

Inspired by cognitive radio applications, we study a noncooperative multi-player game of 
individual rational customers in a queueing network composed of two queues with different 
regimes. The first one is a free shared FIFO queue with waiting time affected by congestion. 
Wishing to avoid congestion, customers may choose to turn to the second server that offers 
service with no delay. However, the endeavor in reaching the second server is costly, and can 
go unrewarded because requests are blocked when the server is busy. Still, blocked customers 
do not leave the system empty handed - they are rerouted to the shared queue. The decision 
and benefit of each customer depend on the choices of others, bringing about a competition of 
utility-maximization among them. After analyzing the queueing characteristics of the system 
we show, by properties of the cost function, that a unique symmetric Nash equilibrium exists. 
Comparing the equilibrium strategy with the socially optimal strategy we find that in some 
cases, contrary to intuition, more customers choose the loss system than is socially preferred. 


1 Introduction 

It is sometimes the case that customers choose between anticipating different queues of different type 
or discipline (see [4] §8.2 for a survey). In particular, we refer to situations that involve choosing 
between a blocking subsystem and a shared subsystem of an unlimited capacity. A prominent 
application motivating the analysis of such decision problems comes from the framework of cognitive 
radio networks (CRNs). 

Cognitive networks, due to their nature, are often associated with variations of unobservable 
queueing systems, in which customers are not informed of the queue length upon arrival (as in [1], 
[3], [7] and [9]). The concept of the unobservable M/M/1 queue was first introduced by Littlechild 
[11] and by Edelson &; Hildebrand [2], and is covered in detail by Hassin & Haviv [5]. In [1] and 
[9], Do et al. and Jagannathan et al. study a generalization of the unobservable M/M/1 queue 
that models customer behavior in a CRN with users of two different types. Corresponding to [1] 
and [9], an observable variation of a queue with server breakdowns (in which customers make their 
decisions based on the observed queue length) is studied by Li &; Han in [10]. 

*This research was supported by the ISRAEL SCIENCE FOUNDATION (grant No. 355/15) 


1 



One type of networks which, according to a survey paper by Haykin [8], is of a particular 
interest is the sensing-based networks. In sensing-based CRNs, users are endowed with the ability 
of sensing the channel, i.e., listening to the spectrum and detecting its state. Using this ability, 
users can determine whether or not the channel is idle and thus allocate their transmit power 
while maximizing their own benefit. As the act of sensing can be expensive (in terms of energy 
consumption, time, etc.), some users might waive sensing and join an unlicensed, freely-shared 
channel. Habachi & Hayel [3] investigate the decision process of users choosing between sensing 
and not sensing in a system consisting of two classes of customers, primary and secondary. Upon 
arriving to the system in [3], each customer chooses between joining a shared M/M/1 or applying 
(i.e. “sensing”) for a free server in an M/M /s/s loss system. 

Another related application is of last mile delivery services, where customers choose between 
two service regimes: door-to-door delivery or self pickup. Driven by this problem, Hayel et al. 
[7] consider a decision problem of customers choosing between an unobservable M/M /s/s and an 
unobservable M/D/1 queue. Other fields of practice include cloud computing services and the like. 

The authors of [3] and [7] assume that sensing customers rejected by the blocking system leave 
never to return. This approach simplifies the analysis as it permits the division of the system into 
two queuing subsystems with two independent Poisson arrival streams. However, a model that 
permits customers to leave the system without being served raises concerns regarding the utility of 
service; In [3], only costs are considered and what in some cases blocking becomes beneficial for the 
customers. If on the contrary one assumes a fixed service reward, then customers must be given the 
opportunity of balking from the system when they are forced to bear a negative expected return. 
A natural question therefore would be how is the decision process changed when allowing blocked 
customers to join the shared queue? 

Presented in this paper is a model closely related to the one in [3] and [7], but the assumptions 
made on the consequences of rejection make a significant difference. We study a network consisting 
of two servers, one queue, and homogeneous customers. One of the two servers in this model is a loss 
system (M/M/1/1); customers trying to enter the loss system (for the sake of avoiding congestion) 
are exposed to the risk of rejection. In addition, the act of sensing as itself, even when ended 
with rejection, is costly. As opposed to previously mentioned models, here we assume that sensing 
customers, upon encountering rejection are redirected to the shared queue. Thus, the queue in the 
system not only populates customers who initially choose to join it but also absorbs the blocked 
sensing customers. This assumption induces dependencies between the state of the loss system 
and the inter-arrival times of customers to the queue. More formally, the queue within this model 
functions as a modification of an M/M/1 queue in which the rate of arrivals is subject to Poisson 
alternations. Such Heterogeneous Arrivals Queues, were analyzed by Yechiali & Naor [12], and the 
results lay the foundations to the queueing analysis in this paper. For the sake of keeping the model 
simple and reducing the number of parameters in the problem, we assume that service times in 
both servers are of identical rates. We shall mention that all the results to be presented hereafter 
can be easily extended to the case of different exponential rates for each server. 

Our key results in this paper are two: First we show that there exits a unique equilibrium 
strategy, which in general, but not always, is different from the socially-optimal strategy. Second, 
depending on the system parameters, customers may sense the loss system more than what the 
social planner would desire. In other words, sometimes customers who wish to avoid congestion 
cause a decrease in social welfare. Consequently, the price of anarchy is not a unimodal function of 
the system utilization. This arises counter intuitively inasmuch as selfish behavior in most models 
always yields to excessive joining to the shared queue, due to negative joining externalities (see [2], 
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[5] and [11]). Yet, these cases which we call over-sensing are rare and their significance in serving 
any practical purpose is uncertain. 

We begin by presenting the mathematical model in §2. In §3 we derive stability conditions for 
the system. Afterwards, in §4 and §5 we find the equilibrium and the socially-optimal strategies 
and compare them using the concept of price of anarchy. Finally, in §6 we discuss possible future 
ways of generalizing the model for further investigation. 


2 System-model 

We consider a system composed of two identical servers, Sq and Sl (Q for queue, L for loss) and 
a single FCFS unobservable queue (see Fig.l). Each service duration is exponential with rate p. 
Customers are identical, and arrive at the system following a Poisson process with rate A. Upon 
arrival, a customer chooses one of two options: pay a sensing price and try to attain service in 
Sl, an action we shall call sensing, or join the shared queue and wait until accepted to service in 
Sq, which will be named joining. Customers sensing Sl when the server is idle are immediately 
accepted to service, whilst sensing Sl when busy, they get rejected by Sl and redirect to the shared 
queue to wait their turn to service by Sq. 

Denote by p the probability that a customer senses Sl, and denote by (X(t), Y{t )) the state of 
the system at time t. Y(t) G {0, 1, 2, . . .} expresses the number of customers in the queue including 
the one in service in Sq. Y(t ) G {0, 1} expresses the state of Sl, where Y(t) = 0 means that Sl is 
idle at time t. Thus, the system can be described as a bi-dimensional Markov process, as shown in 
Fig. 2. Let Pi j be the stationary probability that X(t ) = i and Y(t) = j at some arbitrary moment 
t. In order to simplify the notation, when dealing with stationary probabilities we omit the use of 
t and denote the state by (X,Y), and P ltJ = Pr(A = i,Y = j). The stationary probabilities are 
computed through the following set of equations: 


A-Po,o - pP\ ,o - pPo.\ = 0 , 

(p + A)P 0 ,i - M-Po,o - P p \,\ = 0 , 


Vne{l,2,...} : 


{p T A )P n ,0 (1 P)AP n — i ; o pPn+ 1,0 pPn.l — 0 , 

(2 l~l T A )Pn,l pAP n fi A -Pro— 1,1 pPn+ 1,1 = 0 , 


These equations lead to the following relationship: 


(2.2) 


Vn G {0, 1, 2, . . .} : P n +1 o + Pn+ 1,1 — — ((1 — P)Pn,0 + Pn, 1) • (2.3) 

h 

By the assumption that each individual chooses randomly and independently whether or not 
to sense, we deduce that subsystem Sl can be considered as an M/M/ 1/1 queue (Erlang’s Loss 
Model) with arrival rate pA and service rate /a. Denote p := A /^, then the loss-probability of Sl, 
i.e., the probability that a customer sensing Sl will find it busy, is: 


Pr(Y=l) = ^P iil 

i=0 


pA 

p + pA 


PP 

1 +PP' 


(2.4) 
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Figure 1: A flow chart of the system 


and its complement: 


Pr(Y = 0) = 1 - Pr(Y = 1) = P ifi 


p+pA 1 +pp 


Summing the equations in (2.3) over n = 0, 1, 2, . . . and utilizing (2.4) and (2.5) we get: 


Pop + Po,i = 1 - P ( 1 - T-p- — (2.6) 
V 1 + PP/ 

which indicates a linear relationship between Pq, o and Pop- 

Subtracting the second equation from the first one in (2.2) and combining with (2.3) we deduce 
the following formulae: 

' Tl Tl 

P n + 1.0 = (1 - P)pPn, 0 +PpYj Pip ~ E P i,l , 

Vn£ {0,1,...} : „ * =0 n i=0 (2.7) 

P,i+ 1.1 = pPn, 1 + I] T’i.l -PPYl P iP ■ 

< 2—0 2—0 

It can be seen from (2.7) that, for given p and p, every value P n +i,k ,k € {0, 1}, is expressed as 
a linear combination of the values {Pop, Pip, ■ ■ ■ , P n p, Pop, Pi,i, • • • , P n ,i}- Hence, with (2.6), it 
follows by induction that for each nS {0,1,.. .} and for each k £ {0, 1}, P n ^ is a linear function of 
Pop, as a countable sum of linear functions. 

An accurate solution for (2.7) (including an analytic solution for Po,o) is presented in a paper by 
Yechiali and Naor [12], but in an implicit form, since the solution makes use of Cardano’s formula. 
The method in [12] can be utilized in evaluating the quantities E[A], E[A|Y = 0] and E[A|Y = 1] 
- the expected value, expected value given Sl is idle and the expected value given Sl is busy of 
the variable X, respectively. 
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Figure 2: The Markov chain describing the transitions between states in the system 


3 System-utilization 

We now intend to find the maximum utilization of the system. The effective-arrival-rate to the 
shared queue, \{p,p), consists of two streams of arrivals: customers who join the shared queue 
without sensing at all (whose proportion is 1 — p) and customers who sense Sl and find it busy 
(whose proportion is p ■ Pr(T = 1)). Therefore, 

X(p. p) = (1 — p) A + p ■ Pr(T = 1)A . 

Using (2.4) and dividing by p we get the effective-utilization, p(p, p): 

Pip: P ) := -A(p, p) = P~PP+ PP PP = P ~ — 1 — PP , (3.1) 

p 1 +pp 1 +pp 

which is monotone decreasing in p for every p 6 (0,oo). 

Note, by (2.6), that p(p,p) is equal to 1 — (Po,o + -P 0 ,i), f° r ^ represents the busy fraction of 
subsystem Sq. 

The stochastic process representing the stream of arrivals to the shared queue is not Poisson 
when p > 0. This is because the inter-arrival times to the queue are not i.i.d. , and the arrival is 
higher when Sl is busy than when it is idle. This is a special case of queues with heterogeneous 
inter-arrival times presented in [12]. For the system to remain stable, as implied by [12], we assume 
p{p,p) < 1. 

Recall the golden ratio, tp = 1/2 • (1 + & 1.618. Then: 

Proposition 3.1. The system is stable if and only if p £ [0, p) and p G (p, 1], where 

p-l 

p(2-p)‘ 

Proof. A necessary and sufficient condition for stability is: p(p, p) < 1. Substitute (3.1) and isolate 
p in the inequality to get an equivalent stability criterion: 

^ P~ 1 

P p(2-p) 1 
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Figure 3: A colormap showing the p-p-plane divided into areas for which the system is stable and 
unstable. The shaded area in the graph shows values of p and p for which the system is stable, 
which are bounded by the curve p. 


stable 


unstable 


from which it is clear that the system is stable for all p G \p, 1]. 

Finding the maximum throughput we assume that p = 1, which means everyone senses Sl 
before joining the queue. This follows the monotonicity of p(p, p) as a function of p. Then, from 
(3.1), the stability criterion is: 

/K 1 ! p) = y-— < 1 P 2 ~P~ KO 44 p < 1 + ^ = ip 

1 + p 2 

concluding that the system is stable for every p G [0, ip) and p G (p, 1], otherwise it is overloaded. □ 

Throughout the paper we assume that p G (0, ip) (when p = 0 the solution is trivial). Fig. 3 
shows the domain of possible pairs (p,p) such that the system is stable, which is bounded by the 
curve p. 

4 Equilibrium Strategy 

In this section we discuss the (Nash) equilibrium strategies in the system. Let c w > 0 be the cost 
per unit time of waiting in the shared queue, and c s > 0 be the cost of sensing (incurred by each 
customer who chooses to sense, regardless of the result of this action). Since all customers are 
identical, and each one arriving at the system is eventually attained to service, neither the reward 
from service nor the time spent in service is relevant. Of course, the state of the system, including 
the length of the queue and the status of the servers, is unobservable as mentioned, and unknown 
to the customers at the time they make their decisions. We assume the system is not overloaded 
(i.e., p G (0, ip)) and all customers act to reduce their expected cost to minimum. Denote by Cs(p) 
and Cn(p) the expected cost of an individual who chooses sense and not sense , respectively, given 
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that the others’ sensing probability is p. We have 


Cn(p) ■= ^E[X] , 

C s {p) ■= c s + Pr(y = 1 ) • [X | Y = 1 ] . 


(4.1) 


We shall now show that there exists a unique equilibrium strategy. To this end, we first point 
out some properties of E \X \ Y = 0], of which we will make use in the proof: 

Proposition 4.1. The function E [X \ Y = 0] is continuous and monotone non-increasing in p. 


The proof is in the Appendix. 

Denote 7 := c ™/ilc 3 . The value of 7 can be interpreted as the normalized cost of waiting a single 
service period, c ™/n, paid in currency with rate c s . Similarly, '/-/ is the fixed normalized sensing 
cost. 

Proposition 4.2. For every p £ (0, ip), and for every 7 > 0, a unique equilibrium strategy p e £ [0, 1] 
exists. 


Proof, p £ [0, 1] is an equilibrium strategy if no individual can benefit from choosing any alternative 
strategy. Recall Cs and Cn as defined in (4.1). Thus, the conditions for equilibrium are as follows: 

• If for all p £ [0, 1] Cn{p ) > Cs(p ) then p = 0 is an equilibrium strategy. 

• If for all p £ [0, 1] Cn{p ) < Cs(p ) then p = 1 is an equilibrium strategy. 

• If for some p £ (0, 1) Cn{p ) = Cs(p ) then p is an equilibrium strategy. 

Other cases are infeasible considering that Cn{p ) and Cs(p ) are continuous. 

Suppose first that there exists a value of p such that Cn{p) = Cs(p). Note that: 

E [X] = Pr(E = 1) • E [A | Y = 1] + Pr(E = 0) • E [A | Y = 0] . 

Substitute this expression in (4.1) and divide by c s to get that p e = p € (0, 1) if and only if 

7 Pr(y = 0) • E [A | y = 0] = 1 , 
which, by integrating (2.5) is equivalent to 

7E [x | y = 0] = 1 + pp . 

Note that the function 1 +pp is continuous and strictly monotone increasing in p, and therefore, 
using Proposition 4.1, we deduce that if there exists a solution p e to (4.3) then it is unique, implying 
that p e is a unique equilibrium strategy. 

Suppose now that there is no p satisfying (4.3). Then if 

Vp£ (0,1) : 7 E[A I y = 0] > 1+pp, (4.4) 

following Proposition 4.1 and the monotonicity of 1 + pp, we have that 

7 E [A | y = 0] > 1 + p , ( 4 . 5 ) 


(4.2) 

(4.3) 
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or equivalently: Cjv( 1) > C's(l). This means that sensing is a dominant strategy for all individuals, 
and therefore p e = 1 is a unique equilibrium strategy. 

Finally, assume that 

Vp G (0, 1) : yE [X \ Y = 0] < 1 + pp , 

equivalently, 

yE [X I y = 0] < 1 , (4.6) 

implying that Cjv(0) < Cs{ 0), and p e = 0, which is unique. □ 

This result is not as intuitive as it seems, since the function Cs{p) is not necessarily monotone 
(as shown in Fig. 4a and 4b). This fact can be explained as follows: an increase in the proportion 
of customers that sense results in a decrease of the probability to attain service in Sl on one hand. 
It also decreases the expected queue length, and shortens the waiting time of the customers who 
failed to attain Sl on the other hand. Nevertheless, the equilibrium probability p e is unique. 

Proposition 4.3. The pure strategy p = 0 is an equilibrium strategy (in other words p e = 0) if 
and only if: 

1 


Proof. Assuming that p{0,p) = p < 1, from (4.6), p = 0 is an equilibrium strategy if and only if: 

yE[X | Y = 0] < 1 . 

Note that in this case the queue is an M/M/1 queue, and 

E[X | Y = 0] = E[X] = ^ — . 


Thus, a necessary and sufficient condition for p e = 0 is: 


7 


P 

1-/9 


< 1 


47 


P < 


1 

1 + 7 ’ 


□ 


Proposition (4.3) provide a necessary and sufficient condition for p e 
derive a similar condition determining when p e = 1. Define g(z) as 


0. We would like to 


g(z) := (1 - p)p 2 z 3 - {p 2 + (3 - 2 p)p)z 2 + (2 p + 2)z - 1 . (4.7) 


In their work, Yechiali and Naor [12] has shown that the polynomial g(z) possesses a unique root, 
denoted zq, in the interval z G (0, 1), and that: 


(1 ~ P)z o 

(1 - zq)( 1 - pzo) ' 


(4.8) 


Define the partial generating function of the system for Y(t) = 0 as: 

OO 

G y =o{z) ■= z m P 0 , m , \z\ < 1 . 

m = 0 
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(4.9) 



It has been proven by [12] that 


Note that 


G y = o(z) = 
E[X | Y = 0] = 


1 - p + Pp, q(1 - z)(p- 1) 

9{z) 


1 


d 


Pr (Y(t) = 0) dz 




2=1 


hence, denoting g'{ 1 ) := ( d /dz)g(z)\ z= i 


E[X | Y = 0] = 


ff(l)(l -p-(p- 1)Pq,q) - g / (l)(l - p) 
(g( l )) 2 • Pr (Y(t) = 0 ) 


(4.10) 


Proposition 4.4. The pure strategy p = 1 is an equilibrium strategy (in other words p e = 1) if 
and only if: 

e 2 + d 3 ~ 0 4 

7 > 


l-0-0 2 + 0 3 


where 6 := ^/l + p. 


Proof. Observing that for p = 1 g(z) becomes a polynomial of the second degree, 


zo = — 1 — 
P 


1 


1 


With (4.8) we obtain 


Po, o — 


\J p + 1 / (1 + 0)0 

1 + 0 - 0 2 


0 


Substituting this result in (4.10), after basic algebraic manipulations we get 

E [W | V = 0 ] = 1 + - 

Recall by (4.5) that p e = 1 if and only if yE [X \ Y = 0] > 1 + p . We have then that p e = 1 if 
and only if 


7 1 + 


0 ( 2 - 0 2 ) 
1 + 0 - 0 2 


> 0 2 


(4.11) 


Since 1 + 0 — 0 2 > 0 for every p £ (0, +), we can multiply each sides of the inequality in (4.11) by 
1 + 0 — 0 2 , and after rearrangement we get the desired result. □ 


As a matter of fact, the technique of proving Proposition 4.4 is useful in formulating necessary 
and sufficient conditions not only for p e = 1 but also for every value p e £ (0, 1). Put simply, for 
every set of parameters p £ ( 0 , <p) and 7 > 0 one can evaluate p e analytically and without any 
computational difficulties. This is done by substitution of (4.10) in (4.3) and solving the equation 
for p (the solution depends on the root of the polynomial g(z)). In particular, when p = 1, 
equation (4.10) yields E[X | Y = 0] = 1 /p, and applying the conditions for equilibrium it emerges 
that p e = min { 1 / 2 (- v /l + 4y — l),l}. This result is reflected in Fig. 6 , Fig. 7, and Fig. 13a. Fig . 8 
depicts the value of p e calculated for various values of p and 7. 
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p p 

(a) 7 = 1; p = 0.45 (b) 7 = 1; p = 0.725 

Figure 4: The expected costs of sensing (Cs) and not sensing (Cn) as functions of p cosidering 
7 = 1 and various values of p such that p < 1. 



P P 

(a) 7 = 1; p = 1.08 (b) 7 = 1; p = 1.515 

Figure 5: The expected costs of sensing (Cs) and not sensing (Cat) as functions of p cosidering 
7 = 1 and various values of p such that p > 1. 
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Figure 6: The expected costs of sensing (Cs) and not sensing (Cat) as functions of p cosidering 
p = 1 and various values of 7 such that 7 < 1. 
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(a) 7 = 2.5; p = 1 

Figure 7: The expected costs of sensing (Cs) and not sensing (Cat) as functions of p cosidering 
p = I and various values of 7 such that 7 > 1 . 
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Figure 8: The equilibrium strategy p e as a function of p for a various values of 7 

5 Social Optimization 

We now turn our attention to social optimization. The social objective function (normalized in 
c ™/if), C(p), is defined as 

C(p) ■= — ((1 -p)C N (p) +pCs{p )) , (5.1) 

C"w 

and represents the normalized expected cost of a customer when the probability of sensing is p. 
Combining (5.1) and (4.1) we obtain 

C(p) = - + (1 -p) ■ E[X] +p- Pr(Y = 1) • E[X | Y = 1] . (5.2) 

7 

Define F(p) as follows: 

F(p) := (1 - p) • E[X] + p ■ Pr(Y = 1) • E[X \ Y = 1] , (5.3) 

which implies that C(p) = p/j + F(p). F(p) can be interpreted as the social cost function in a 
system of which c s = 0 and c »//i = 1 (that is to say sensing is free of charge and the expense of 
waiting for a single service period is 1 on average). 

Proposition 5.1. The function F(p) is convex in p. 

The proof is in the Appendix. 

Denote p* the socially optimal strategy. Accordingly, 

p* := arg min C (p) = argmin < — + F(p) > . (5-4) 

p€[0,l] p€[0,l] 1 7 J 

From Proposition 5.1 we immediately achieve that C(p) itself is a convex function, thus, p* is well 
defined. 

Proposition 5.2. 
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(a) p* = 0 if and only if p < 1 — y^/i + 7 . 

(b) p* = 0 = 7 - p e = 0 . 


Proof. 


(a) Suppose p = 0, then the system is an M/M/1 queue with arrival rate A. This is socially 
optimal if and only if society prefers to bear all the social cost imposed by an individual that 
chooses not to sense rather than pay the cost of sensing. We tag the “transparent” customer 
as the one assigning the lowest priority, that is to say preempted by every other customer. 
Note that if this tagged customer senses, he/she will find Sl idle and no other customer will 
preempt him/her because p = 0. It was shown in [5] that since the arrival and action of 
the transparent customer imposes no externalities on other customers, the optimal strategy 
for the transparent customer coincides with the socially optimal strategy. Thus, p* = 0 if 
and only if the transparent customer prefers not to sense. As explained by [ 6 ], in an M/M/1 
system, the queueing time of the transparent customer equals 1 //j ( 1 - P ) 2 — 1 / P . This is the 
product of the expected queue length (f/i - P ) and the expected time it takes to reduce the 
queue size by one (V+i - p)) minus the expected service duration (Vm)- We deduce that p* = 0 
if and only if: 


1 1 'i 

Mi - p) 2 v;~ Cs 


47 7 


(1 - p? 


- 1 < 1 47 p < 1 - 


7 

1 + 7 


(b) This result can be verified both algebraically and intuitively. Recall Proposition 4.3: 


p 1 

Pe = 0 47 7 - >1 47 p < — ~ 

1-/9 1 + 7 


Note that: 
1 - 


/ 7 _ 1 | 

(1 + 7- \ J 7(1 + 7) ^ 

\" 1 ( 

/ 1 + 7 M 1 + 7 ' 

l V !+7 ) 

V 1 + 7 ' 


Where the second inequality follows from 7 < ^ 7(1 + 7 ), concluding that if p < 1 — M 7 / 1 + 4 
then p < 1 /i + 7 . 

We now give an intuitive explanation: Denote W° := p _1 ■ p/i - P the expected waiting time of 
a customer when p = 0 (as in the M/M/1 model). Suppose p e / 0, then by Proposition 4.3, 
7 • p/i - p > 1, which is equivalent to c w W° > c s . This means that an arbitrary customer can 
reduce both his/her own cost and the waiting cost of the others by sensing. Thus, p* 7 ^ 0, as 
claimed. 


□ 


Proposition (5.2) implies that when p e = 0 then p* > 0. In fact, every 7 > 0 satisfies 


1 - 



1 

1 + 7 ’ 
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thus, taking p G [1 — y/7/i + 7 , 1/1 + 7 ] yields p e = 0 < p*. We shall now show that there exist 
values of p and 7 such that p* < p e . In such cases we say that the system is in a situation of 
over-sensing. Although the value of p* is computed in a numerical optimization technique, the 
existence of p* < p e can be proved analytically. We begin by formulating a sufficient condition for 
p* < 1: 

Recall F(p) as defined in (5.3). 

Proposition 5.3. If there exists a value h G (0, 1) such that 

7 “ F(1 - h) - F{ 1) ’ ^ 

then p* < 1. 


Proof. Denote F'(l) : = 
thus, 

p* < 1 


(d/d P )F(p)\ p=1 and C"(l) := ( d /d P )C(p)\ p=1 . 

47 0 < C"(l) =-!-(—+ F(p)) 47 

d P 7 p=i 


Since F(p) is convex we have that for all h G (0, 1): 


As discussed, C(p) is convex, 
7 


F < 1 > - f 1 - ft > < n i) ■ 

Suppose that h G (0, 1) satisfies (5.5), then 


and therefore p* < 1. 


1 ^ F(l)-F(l-h) 
7 — h 


<F\ 1), 


□ 


For a given fixed p and for h sufficiently small, define: 

02 + 03 _ 0 4 h 

7l ^ ' 1 - 0-02 + 03 ’ 72 ^ ' F(1 — h) — F(l) ’ 

where 0 = \/l + p. To this fixed value of p, the relation between these two quantities, 71 (p) and 
72 (p) indicates whether there exists a value of 7 such that p* < p e . Proposition 4.4 states that 
if 71 (p) < 7 then p e = 1. In addition, by Proposition 5.3, if 7 < 72 (p) then p* < 1. We deduce 
therefore that if 71 (p) < 72 (p) then for all 7 G [71 (p), 72 ( 0 ))) P* < Pe = 1- This remarkable 
phenomenon can be spotted in Fig. 11a, Fig. lib, Fig. 12a and Fig. 12b. In particular, taking p = 0.6 
and h = 0.01 satisfies 71 (p) < 72 (p) as demonstrated in Fig. 12b. Binding the aforementioned 
result with Proposition 5.2, we conclude that in some rare cases, p e = p* fi {0, 1}, namely p e is 
an efficient non-trivial mixed equilibrium strategy. Cases as such can be spotted in Fig. 14, which 
shows the two-dimensional p- 7 -plane painted in different colors with respect to each of the three 
cases: p* > p e , p* = p e and p* <p e - 

In case p* < p e then 1 — p e < 1 — p*, and in order to reach optimal sensing rate customers 
should be incentivized to join the shared queue without sensing. We find this an unusual result, 
since in many models, and in Edelson & Hildebrand’s fundamental model in particular (see [2]), 
the proportion of customers joining the queue in equilibrium is never less than the socially optimal 
proportion. The explanation is as follows: Say two successive customers arrive at the system one 
after another. Whereas in most models it is beneficial for the second customer that the first one 
will decide not to join the queue, in this model it is not clear whether the second one prefers that 
the first will sense or join. 
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(a) 7 = 4 (b) 7 = 10 

Figure 11: The socially optimal strategy (p*) and the equilibrium strategy (p e ) as a function of p 
cosidering various values values of 7 such that 7 > 1 . 
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(a) p = 0.3 (b) p = 0.6 

Figure 12: The socially optimal strategy (p*) and the equilibrium strategy (p e ) as a function of 7 
cosidering various values values of p such that p > 1 . 
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Figure 13: The socially optimal strategy ( p *) and the equilibrium strategy ( p e ) as a function of 7 
cosidering various values values of p such that p > 1 . 
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Figure 14: A color map of the two-dimensional p- 7 -plane showing the relation between p* and p e . 
For each pair (p, 7 ), white indicates that p* > p e , gray indicates that p* = p e (in particular where 
they are both equal to 0 or 1 ) and black indicates that p* <p e . 
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Figure 15: The Price of Anarchy (PoA) as a function of p for a various values of 7 
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5.1 Price of Anarchy 


The existence of p and h such that 71 (p) < 72 (p) implies that rational customers, under specific 
conditions, may over-sense Sl- This situation, while possible, may not be a matter of significant 
importance in practice, as the expected cost of customers in equilibrium is only slightly worse than 
that in social optimum under the circumstances of over-sensing. We reach this conclusion based 
upon numerical analysis of the price of anarchy (PoA), which is defined as follows: 


P°A(p, 7 ) 


C(p e ) 

C(p*) ' 


Empirical examination shows that the behavior of PoA as a function of p conforms with the results 
in Proposition 5.2 and Proposition 4.3 (see Fig. 15). For a fixed value of 7 : 


• If P < 1 — y 1+7 then Pe = P* = 0 and PoA = 1. 

• PoA (as a function of p) attains its maximum (non-smooth) point at p = 

where the first and the second properties follow from Proposition 5.2 and Proposition 4.3, respec- 
tively. 

For a fixed given 7 , we define p\ such that 7i(pi) = 7 . If 7i(pi) < 72 ( Pi ), then taking p = p\ 
and 7 to be the system parameters implies that p* < p e = 1. For this fixed value of 7 , we notice 
that PoA is not a unimodal function of p, and attains a local maximum (non-smooth) point at p\ 
in addition to its maximum point at 1 / 1 + ')'- This can be observed in Fig. 16, where 7 = 10. Note 
that in the case where 7 = 10 (see Fig. lib) then p\ ~ 0.49, it holds that 

71 (pi) ~ 10.07 < lim 72 (pi) ~ 11.23 

h— 5-0 

and PoA(0.49, 10) = 1.0005, which means that C(p e ) is marginally greater than C(p*). 
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1.3 


1.2 

PoA 

1.1 


1 

0 .5 1 1.5 ¥> 

P 

Figure 16: The Price of Anarchy (PoA) as a function of p for 7 = 10. This example corresponds 
with Fig. 11a, where p* = p e (i.e., PoA = 1) at p ~ .465, for which the equilibrium strategy point 
is efficient and non-trivial. As shown, PoA is not unimodal in this case. 

6 Concluding Remarks 

This work deals with customer behavior in a queueing model inspired by the framework of CRNs. 
From the queueing analysis aspect, the main challenge is handling the dependency between the 
arrival rate to the queue and the customers’ actions. In this specific model, customers’ actions 
induce a queueing system in a random environment, in which the arrival stream is not a Poisson 
process. 

We manage to show that the equilibrium strategy in this multi-player game is unique, and 
can be either greater, smaller or equal to the socially optimal strategy. This results prevail when 
extending the model to different service rates of Sq and Sl, because the proof depends mainly 
on the fact that the service duration in both servers is memoryless and on the fact that the loss- 
probability of Sl is monotone increasing in p. Only slight changes are needed in order to apply the 
same solution for a network with different service rates, and the differences are primarily technical. 

By proving properties (monotonicity and convexity) of the conditionally expected queue length 
and expected cost (which are functions of the sensing probability) we show the uniqueness of the 
equilibrium strategy, and compare it with the socially optimal one. However, the basic tools of 
calculus are of no use as these functions are given in an implicit form. In this paper, specifically 
in the proof of Proposition 4.1 and Proposition 5.1, we present a construction of an appropriate 
coupling argument that appear to be essential for the analysis of the model. Thus, we solve the 
problem of finding the equilibrium strategy analytically. 

Further investigation and discussion is needed in order to apply the results in this work on 
models where there can be more than one server to sense. Extending the number of servers in 
a way that Sl becomes an M/M /s/s queue changes the state space of the system such that the 
solution of Yechiali & Naor [12] is no longer suitable. An accurate description of the decision 
problem in that case should regard the sensing methodology: how many servers are sensed, how 
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they are sampled among the collection of servers etc. If we consider a case where each sensing 
customer is blocked if and only if all the loss system servers are all busy, then it can be shown in 
similar methods to those presented here, that the equilibrium strategy is unique. 
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8 Appendix 

8.1 Proof of Proposition 4.1 

Proof. Proving the continuity of E [. X \ Y = 0] is immediate as, referring to (2.5), (2.6) and (2.7), 

^ oo oo 

E [X I r = 0] = Pr|y = 0 ' E ip ‘» = (! + VP) E *fU . 

' ’ i = 0 i = 0 

which is a countable sum of continuous functions in p £ [0, 1]. 

In order to prove monotonicity, we examine the transitions between states in two systems, 
P := {5 q,5l} and P 7 := {£q,£^}, under the same sequence of events. Systems P and P' are 
identical except that in P the sensing probability is p, as opposed to P', where the sensing probability 
is p ' , and p < p 1 . 

Denote by (X(t),Y(t)) and (X'(t),Y'(t)) the states at time t of systems P and P' respectively. 
Since for all p £ [0, 1] the state (0,0) in the Markov chain is recurrent, we can assume w.l.o.g. that 
at time t = 0, 

(X(0),F(0)) = (Y'(0),y'(0)) = (0,0). 

Showing that 

Vi £ [0, oo) : E [X’(t) | Y\t ) = 0] < E[X(f) | Y(t) = 0] (8.1) 

will complete the proof. 

We begin by attaching three variables to each customer: Let {(X), r*, Ui)} ieN represent the arrival 
time , service duration and sensing aversion of the i-tli customer respectively, and for all i £ N: 

T i+ 1 - Ti ~ exp (A) , Ti ~ exp(^) , m ~ U[0, 1] . (8.2) 

Each customer arrives to both systems simultaneously. Customer i arriving at P senses if and only 
if Ui < p while arriving at P ; he/she senses if and only if Uj < p'. This ensures that the sensing 
probability is p in system P and p r in system P ; , and as a matter of fact, implies that customers 
who sense in P also sense in Ph 

We assign each customer one of three types based on the values of their sensing aversion: 
Customer i will be assigned 

• type-L (stands for “Low”) if u t £ [0,p], 
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• type-M (stands for “Medium” ) if rq E (p, p '] , 

• type-H (stands for “High”) if u, e (//, 1], 

By definition, upon arrival, an H-type customer joins both Sq and Sq, the shared queues in H and 
ft' respectively, an M-type customer joins Sq but senses S' L , whereas an L-type customer senses 
both Sl and S' L . 

W.l.o.g., we modify the service regime as follows: 

(i) Arriving at ft (ft') when Sl ( S ' L ) is busy, customer i preempts the customer in service in Sl 
(S' L ) with no regard to type, and the preempted customer is routed to continue the service 
in Sq (Sq). Arriving at ft (ft') when Sl (S' l ) is empty, customer-i’s actions follow by type. 

(ii) The shared queue, subsystem Sq (Sq), is a preemptive resume LCFS-PR queue, meaning 
that customers are served following a preemptive last-come- first-served discipline, and the 
preempted service resumes from the last point it stopped. 

Lemma 8.1.1. Assumptions (i) and (ii) do not affect the stationary probabilities of the systems. 

Proof. We shall show that Lemma 8.1.1 holds for system ft and the proof for ft' is identical. 

Let i and i + 1 be a successive pair of customers and suppose that customer i + 1 preempts 
customer i in subsystem Sl- Denote A^+i := 7 ) + 1 — T, the time difference between their arrivals. 
Then, as a result of the memoryless property of the exponential distribution, the service duration 
of customer i + 1 (i.e. , r,:+i) and the residual service of customer i (i.e., r, — | r, > Aj^+i) are 

independent and identically distributed. This incident of preemption is equivalent to the joining of 
the new comer to subsystem Sq, the shared queue, when Sl is busy. Hence, assumption (i) does 
not influence the transition probabilities and the stationary probabilities remain as before. 

The validity of assumption (ii) can be explained by the fact that in a work-conserving preemptive 
resume system with exponential service duration, as sustains in Sq, the queue length is independent 
of the service regime. Consequently, assumptions (i) and (ii) do not restrict the generality of the 
model. □ 

Exploiting assumptions (i) and (ii) we immediately achieve several properties that will be later 
used in the proof: 

Lemma 8.1.2. Under assumptions (i) and (ii), the following arguments hold: 

(a) At any moment, if Sl (S' l ) is busy, then the last customer to arrive until that moment is in 

S L (S' l ). 

(b) Both in ft and in ft', all customers begin service at the moment of arrival, whether they sense 
or not. 

(c) Customers beginning service in Sl upon arrival, begin service in S' L as well. 

(d) Customers beginning service in Sq upon arrival, begin service in Sq as well. 

(e) The sojourn time of customer i in Sq is no longer than the sojourn time of i in Sq. 
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Proof. 


(a) Suppose i is the last customer until time t. and i is not in Sl at time t. From assumption 
(i), this is possible if either i is of type L and Sl is idle at the moment of V s arrival, or if i 
joins Sl and completes service before time t. Hence, in both scenarios, Sl stays idle at time 
t. The proof for Q' is similar. 

(b) In system H, customers at their moment of arrival either begin service immediately in Sl, 
or, by assumption (ii), join the head of the shared queue, thus beginning service in Sq. The 
proof for Q' is similar. 

(c) Recall that at time t = 0 both Sl and S' L are empty. Only upon the arrival of an L-type 
customer will the state of Sl alter. Arriving at O', an L-type customer joins S' L , regardless 
of the server’s state. Suppose the last customer has joined both Sl and S' L . By assumption 
(i), this tagged customer can either complete service in Sl and S' L simultaneously (so Sl and 
S' L become empty) or be preempted in the two subsystems by the next customer to come. 
As for the latter case, it holds that the preempting customer joins both Sl and S' L . Thus, it 
follows by induction that customers who join Sl also join S' L . 

(d) This property is immediately achieved as the modus tollens form of property (c). 

(e) It results from assumption (ii) that the sojourn time of each customer in the shared queue 
depends only on future arrivals. Combining this with property (d) we deduce (e). 


□ 


With property (c) and the simultaneousness of occurrences we get: 


Vt € [0,oo) :{Y(t) = !}=>{¥’ (t) = l}, 


or, in an analogous fashion: 


Vt G [0, oo) : {Y'(t) = 0} =» {Y(t) = 0} . (8.3) 

Moreover, from properties (d) and (e) we see that, if at an arbitrary point in time there is a 
customer waiting in Sq, then the same customer will also be waiting in Sq, not leaving Q before 
leaving IT. Therefore, 

Vt G [0, oo) : X'(t) < X(t) , (8.4) 

implying that the process representing the number of customers in Sq over time stochastically 
dominates the one representing the number of customers in Sq. 

For the sake of simplifying the notation, when there is no ambiguity we denote (X(t), Y(t )) and 
(X'(t),Y'(t)) by (X,Y) and by (X',Y') respectively. On utilizing (8.4), we get 

E[X' | Y' = 0] < E[X | Y’ = 0] . 

To prove our claim (8.1) it suffices to prove: 

E[X | Y' = 0] < E[X | Y = 0] . (8.5) 
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Denote by i the last customer who arrived by time t, and let 

A(t) := {i joined Sq and T* + n > t} 

express the event “i joined the queue in D and was still in the system by time t” . For i being the 
last customer, by property (b) we get that A(t) occurred only if i was still in service in Sq by time 
t. Therefore from property (a), 

Vi € [0, oo) : A(t) => {y (t) = 0} . (8.6) 

Recall that by property (a) if there is a customer in S' L at time t then it must be i (the last 
customer arrived). So, assuming that Y(t) = 0 and Y'{t) = 1, we have that customer i, arriving at 
D, joined Sq, and at the same time, arriving at 1Y , began service in S' L . As i was the last customer 
until time t, knowing that Y'(t) = 1 implies that T) + r, > t. Hence, 

Vt € [0, oo) : {{y'(t) = 1} n {Y(t) = 0}} => A(t) . (8.7) 

Lemma 8.1.3. Conditioned on A(t), X(t) and Y'(t) are independent random variables. 


Proof. Let t be an arbitrary point in time and i be the last customer to arrive by that time. 
Assuming that A{t) had happen, it means that i was still in Q by time t. The residual service of 
customer i at time t is an exponential variable with parameter p. Thus, we can assume w.l.o.g. 
that i’s arrival (at time T t ) occurred a short moment before t. A(t ) can be rewritten then as the 
event when a new busy period in Sq began right before t (i.e., t = T) + := Tj + e, where e is a small 
positive infinitesimal quantity). 

Denote Tf the moment after customer n’s arrival. To prove Lemma 8.1.3 we shall show by 
induction that Vn € N, X(T+) and Y'(T+) are conditionally independent given A(T+). 

Presume that A(T+) is satisfied. Having that n joined Sq means that n is not of type L, and, 
by (8.6), Y(T+) = 0. Define T~ := T n — e, where e is a small positive infinitesimal quantity, the 
moment before n’s arrival. Then, 

X(T+)\A(T+) = X(T~) + 1. (8.8) 

Regarding n’s arrival at fY, there are two possibilities: 


• Upon n’s arrival, S' L was empty (i.e., Y'{T n ) = 0). 

• Upon n’s arrival, S' L was busy (i.e., Y'{T~) = 1). 


To the extent that A(T l f ) holds and Y'(T n ) = 0, n’s action (and therefore the state of S' L ) is 
determined one to one by n’s type (M or H): 


Y\T+) | A(T+) 


0, iff n is of type-H, 

1, iff n is of type-M; 



i -v' 

i -p ’ 
p'-p 
i -p ' 


Since i’s type does not depend on previous events in the system it follows from (8.8) that X(T 7 f) 
and Y'(T+) are independent conditioned on A(T+). 

To the extent that A(Tf ) holds and Y'(T~ ) = 1, with assumption (i), n must have preempted 
his/her predecessor, n — 1, in S' L , simultaneously as joining Sq. This is possible only if customer 
n — 1 remained in service until customer n’s arrival, and indicates that 
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(a) Customer n — 1 joined Sq upon arriving at P, and Y(T +_ = 0. 

(b) Customer n — 1 joined S' L upon arriving at P', and Y'(T+)\A(T+) = Y'(T+_f) = 1. 

(c) Customer n had arrived before n — 1 left Sq, and X(T+)\A(T+) = X(T^f_f) + 1. 

From (a), (b) and (8.7) we deduce that A(T +_ a ) holds. Followed by the induction hypothesis, 
X(T+_,) and Y'iT^) are independent conditioned on J 4(T n t "_ 1 ). Thus, from (b) and (c) we conclude 
that X(T 7 f) and Y'(T+) we are also independent conditioned on A(T+_f). 

It is left to show that A(Tj + ) and Y'(T+) are conditionally independent given A(Tj + ). We 
can assume, w.l.o.g., that Y'(Ti) = 0 (otherwise we observe the last customer that arrived before 
Ti). Thus, as discussed, cusotmer l’s action is equivalent to type, which is a random variable 
independent of X (T+ ) . □ 

Define the operator Ey = o[«] := E[« | Y = 0]. Combining Lemma 8.1.3 with (8.7) we arrive at 
E y =o[X | A] = E Y=0 [X | A, Y' = 1] = E y=0 [X \ Y' = 1] . (8.9) 

Since A(t) indicates the beginning of a new busy period at time t 


E y= 0 [X] < E y=0 [X I A] . 


Upon substituting (8.9) we get 


E y= 0 [X } < E y=0 [X | Y' = 1] . 

By the law of total expectation we have 

E y= 0 [X] = E y=0 [X | Y' = 0] • Pr(W = 0 
Ey =0 [X I Y' = 1] • Pr(E / = 1 
= E[X | Y’ = 0] ■ Pr(W = 0 | Y 
Ey =0 [X Y’ = 1] •Pr(E / = 1 

where the second equality follows from (8.3). Note that the right-hand side of (8.11) is a convex 
combination of E[X \ Y' = 0] and Ey = o[^f | Y' = 1]. Amalgamating (8.10) and (8.11) we attain 

E[X \Y' = 0]< E y=0 [X } , 

thus confirming (8.5). This completes the proof of Proposition 4.1. □ 

8.2 Proof of Proposition 5.1 

Proof. Given that c s = 0 and = 1, the expected cost of a customer (F(p)) is the expected 
number of customers ahead of him/her, which varies depending on his/her action (sensing or not 
sensing). For some 5 such that p + 6 < 1, define D(p) as the proportionate difference in social cost, 
on average, incurred by increasing the proportion of sensing customers in the system by (5, namely, 

6-D(p) = F(p + 6)-F(p). (8.12) 


| Y = 0) + 
| Y = 0) 

= 0) + 

I Y = 0) , 


(8.10) 


( 8 . 11 ) 
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Lemma 8.2.1. D(p) is monotone non- decreasing inp. 

Proof. As in the proof of Proposition 4.1, recall tt = {Sq,Sl} and tt' = {S'q,S' l } with the states 
(X(t), Y(t )) and ( X'(t ), Y'{t )) and sensing probabilities p and p' (p < p' < 1) respectively. We use 
{(Ti, Ti, - the set of variables defining the queueing process as in (8.2), with T t the arrival 

time, Ti the service duration and Ui the sensing aversion of customer i. We also assume (i) and (ii) 
as in Lemma 8.1.1. 

Tag customer i such that Ui > p' . By definition, customer i does not sense, neither in 11 nor 
in tt' . Thus, forcing this tagged customer into sensing strictly increases the population of sensing 
customers within the two systems. In addition, the fact that each customer that senses in tt also 
senses in tt! is still valid, weather if we say that i senses in both systems or if we say that i does not 
sense in any system. This ensures that Lemma 8.1.2 holds in each of the two cases, i senses and 
i does not. We intend to investigate each system, tt and tt ' , under each of the two circumstances: 
When customer i is forced to sense and when he/she does not sense. Define: 

• Di - The difference between the social cost incurred by i when he/she senses and when he/she 
does not sense in system tt. 

• D' i - The difference between the social cost incurred by i when he/she senses and when he/she 
does not sense in system tt' . 

Recall by (8.3) that for all t £ [0,oo), {Y'(t) = 0} {Y(t) = 0}, thus, 

Vt £ [0, oo) : Pr(y(t) = 1, Y"(i) = 0) = 0 . 

We divide our event space, therefore, into three disjoint cases: When Y (Ti) = 1, when both 
Y(Tj) = 0 and Y'(T t ) = 1, and when Y'iTf) = 0. 

(a) If Y(Ti) = 1 (consequently, by (8.3), Y'(Ti) = 1) then, with the fact that c s = 0, the social 
planer in tt is indifferent between i sensing and i not sensing as both actions result in the 
same outcome, thus Di = 0. In a similar manner, since Y'(Ti) = 1 in tt', D\ = 0. 

(b) If Y'(Ti ) = 1 and Y ( T) ) = 0, as explained above, D' i = 0. Regarding system tt, when customer 
i senses there is the possibility that i will complete service in Sl and X(T ) + 1 customers 
(that is X(T t customers in the queue plus customer i ) would save the expense incurred by i 
joining the queue upon arrival. Thus the social cost when i senses is less than when he/she 
does not sense and Di < 0. 

(c) If Y'(Ti) = 0 (consequently, by (8.3), Y(Ti) = 0) then we separate between two cases: 

• When Ti < T i+ i — Ti, customer i completes service in Sl (and in S ' L ) before the arrival of 
the next customer. Denote by Bi and B' t the sojourn time of i in the queue of tt and of tt' 
respectively, measured in units of 1 /n- From property (e) of Lemma 8.1.2 it is clear that 
B'i < Bi. Since c »/)i = 1, i sensing in tt in this case saves A(7j)R t + B, — 1 relative to not 
sensing (that is X(Ti ) customers in the system saving Bi each, plus customer i saving Bi 
minus the cost of his/her own service). Likewise, i sensing in tt' saves XfT^B^ + B[ — 1. 
Recall by (8.4) that X'(Ti ) < X{Tf), then we have: 

Di = 1 - Bi - X(Ti)Bi < 1 -B^- X'(Ti)B'i = D\ . 
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• When Ti > T i+ i — Tj, customer i, when sensing, begins service in Sl (S' l ) but with 
assumption (i) he/she is forced to join the queue upon the arrival of i + 1. Denote by L 
and U the number of customers that has left the system during the time period [Tj, T i+ 1 ) 
in D and in f respectively. Since X'iTf) < X (T, t ), L' < L. Denote by Bi and B[ the 
sojourn time of i in the queue of D and of Ll' respectively, measured in units of 1 f f. As 
explained, B\ < B{. Then we have L customers in D saving the expense of waiting Bi 
each one and L' customers in IT saving the expense of waiting B\ each one, therefore, 

Di = -LBi < —L'B'i = D[ . 


In summary, for i such that u k > p' , under all circumstances Di < D\. Subsequently, if S C N 
is a subset of customers such that for all j € S, Uj > p' , then 


1 

W\ 


jeS 


j< 


l<5| 




jeS 


This implies that for a given 5, when increasing p by 5, the marginal social cost gets bigger with 
the increase of p, i.e., 


5D(p) = F(p + 5) - F(p) < F(jp' + 5) - F{p') = 5D(p') , 


where the first equality and the last equality follow from (8.12) and we conclude that D[p) is 
monotone non-decreasing. □ 


Note from (8.12) that D[p ) = 1 /s (F(p + 5) — F(p)), so the monotonicity of D(p) implies that 
( d /dp)F(p) is non-decreasing, and therefore F(p) is convex in p. □ 
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